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(57) ABSTRACT 

A deterrent effect for a forgery of an image can be provided 
and both of the protection of a picture quality of an image 
of a relatively low similarity and the prevention of a forgery 
of an image of a relatively high similarity can be realized. 
For this purpose, an image processing apparatus has embed- 
ding processing means for embedding predetermined infor- 
mation which can specify an output apparatus and an output 
date/time as a digital watermark having a resistance accord- 
ing to a similarity with a specific image 106 into an output 
image, thereby enabling the deterrent of a forgery of the 
specific image 106 according to the similarity to be realized 
while outputting an image which the operator intends to 
output. ' 

6 Claims, 4 Drawing Sheets 
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IMAGE PROCESSING APPARATUS, IMAGE 
PROCESSING METHOD, AND STORAGE 
MEDIUM 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention relates to an image processing apparatus, 
an image processing method, and a storage medium. 

2. Related Background Art 

Hitherto, an image processing apparatus reads an image 
on an original put on a copyboard glass or the like and 
accurately performs a recording operation in accordance 
with a printed matter, an electronic storage medium, or the 
like in response to an instruction of the operator. 

According to a recent image processing technique, image 
information whose output has been instructed can be accu- 
rately reconstructed on a printed matter owing to progress of 
a coloring technique. In a conventional apparatus, therefore, 
matters such as bills, securities, or the like whose forgery is 
prohibited or copyrighted works such as pictures or the like 
can be copied and printed by abusing the image processing 
technique or by "out of mischief or the like. 

To solve such a problem, in EP 0529746 Bl, there has 
been proposed an image processing apparatus comprising: 
input means for inputting image information; evaluating 
means for evaluating, at multistages, a similarity between an 
image which is expressed by the image information and a 
specific image whose accurate reproduction is inhibited; and 
processing means for transforming the image information 
inputted at a degree according to the multistage evaluation 
by the evaluating means. 

It is an object of the apparatus to disable the use of an 
output image of an image determined in a manner such that 
it has a similarity with a specific image. For this purpose, a 
transforming process such as color transformation, tilted 
type transformation, enlargement, reduction, or the like by 
which an image can be discriminated by the human being is 
executed in accordance with the similarity. 

According to this apparatus, however, since the trans- 
forming process by which the image can be discriminated by 
the human being is executed even if the similarity with the 
specific image is relatively low, the transforming process is 
executed and a resultant image is outputted with respect to 
another image which has a similarity with respect to only a 
part of a specific image or portions at a few discrete 
positions thereof and in which it is possible to easily 
determine in a manner such that they are different from the 
specific image if they are seen by the human being. 

SUMMARY OF THE INVENTION 

In consideration of the above problems, it is an object of 
the invention to make it possible to have a deterrent effect 
again a forgery of an image. 

Another object of the invention is to make it possible to 
meet both a protection of a picture quality of an image of a 
relatively low similarity and a prevention of a forgery of an 
image of a relatively high similarity. 

Still another object of the invention is to provide a new 
function. 

The above and other objects and features of the present 
invention will become apparent from the following detailed 
description and the appended claims with reference to the 
accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram for explaining an outline of processes 
in the first embodiment of the invention; 
s FIGS. 2A and 2B are schematic diagrams for explaining 
an embedding and an extraction of a digital watermark; 

FIG. 3 is a diagram for explaining an outline of processes 
in the second embodiment; 

FIG. 4 is a diagram for explaining an outline of processes 
10 in the third embodiment; 

FIG. 5 is a diagram showing a construction of an image 
processing system; and 

FIG. 6 is a diagram for explaining an outline of processes 
in the fourth embodiment. 

15 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 
[First Embodiment] 

In recent years, a technique called a digital watermark for 
20 protection of a copyright of digital information has been 
known. Generally, the digital watermark technique is a 
. technique for embedding copyright information, user 
information, various identification numbers, or the like by 
secretly transforming a pixel value or the like of digital 
25 image data? 

By extracting the digital watermark from data, the copy- 
right information, user information, various identification 
information, or the like can be obtained and an illegal copy 
can be pursued. 
30 The first condition which is required in the digital water- 
mark is that embedded information cannot be perceived, 
namely, it can be embedded with a little deterioration of a 
quality of the original digital information (Quality). 
The second condition is that the embedded information 
35 continuously remains in the digital information, namely, the 
embedded information is not lost even by an edition or 
attack such as data compression or filtering process 
(Resistance). 

Further, the third condition is that an amount of informa- 
40 tion to be embedded can be selected in accordance with a use 
purpose (Information amount). 

FIG. 1 shows a schematic diagram for explaining the first 
embodiment of the invention. 
FIG. 5 is a diagram showing an image processing system 
45 which is common to all of the embodiment 1 and subsequent 
embodiments, which will be explained hereinlater. 

Reference numeral 1 denotes a host computer for execut- 
ing processes in a range from an extraction of a similarity 
and a digital watermark to an embedding of a digital 
50 watermark and a modification of an image t in each 
embodiment, which will be explained -hereinlater. Those 
processes are realized by a scanner driver and a printer 
driver installed in the host computer 1. 

Reference numeral 2 denotes a scanner for inputting an 
55 input image and 4 indicates a printer for outputting an output 
image. Although the scanner is used to input an input image 
in FIG. 5, an image from a digital camera or an image 
obtained by a film scanner by reading an image photo- 
graphed by a silver salt camera can be also used as an input 
60 image. 

Reference numerals 3 and 5 denote communication lines 
for inputting the input image from the scanner to the host 
computer or outputting the output image obtained after the 
image was processed by the host computer. 
65 Although a wired communication line is used in FIG. 5, 
a radio interface such as a Bluetooth interface or the like can 
be also used. 
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As shown in FIG. 1, aD input image 101 which the Further, as methods using the discrete wavelet 

operator intends to output is supplied to a similarity extrac- transformation, the following methods can be mentioned: a 

tion unit 102, by which a similarity with a specific image 106 method of Mitsubishi Electric Corp. and Kyushu University 

is first extracted. (Ishizuka, Sakai, and Sakurai, "Experimental examination 

As shown as a bills.securities similar feature extracting 5 regarding safety and reliability of digital watermark tech- 
circuit in the foregoing EP 0529746 Bl, the similarity nique using wavelet transformation", SC1S' 97 — 26D, 
extraction unit 102 can be realized by a circuit or method for January, 1997); a method of Matsushita Electric Industrial 
comparing a color spectrum distribution of an image or a Co., Ltd. (Inoue, Miyazaki,Yamamoto, and Katsura, "About 
part of or the whole image pattern, or the like. It can be also robust performance for digital watermark — image corn- 
realized by a circuit or method for identifying a size, a 10 pressing and transforming processes based on wavelet 
watermark pattern, a magnetic pattern, or the like of an transformation", SC1S' 98 — 3.2. A, January, 1998); and the 
image, or the like. like. 

A resistance of the digital watermark is subsequently In the method of embedding a digital watermark into the 

determined by a resistance determination unit 103 on the space region, it is generally known that although a quality 

basis of the similarity extracted from the similarity extrac- 15 deterioration is small, a resistance is weak. In the method of 

tion unit 102. The resistance changes due to parameters for using the frequency transformation, it is generally known 

deciding the resistance, which will be explained hereinlater, that although a quality deterioration is relatively large, a 

in the case where a digital watermark method that is used is resistance is strong. A desired method can be used as 

fixed. In the case where the digital watermark method that necessary. Also for one digital watermark method, the 

is used can be selected, the resistance changes by selecting 20 resistance can be selected as follows, 

a method while the parameters for deciding the resistance Assuming that input data as copyrighted works is a still 

are also included. image, image data of the still image is divided into blocks 

The correspondence between the similarity outputted each comprising (8x8) pixels and a DCT (Discrete Cosine 

from the similarity extraction unit 102 and the method or Transform) is performed every block. Hereinafter, the DCT 

resistance of the digital watermark can be realized by 25 transformed block is called a DCT coefficient block, one 

previously storing the correspondence into a table, or the coefficient of the DCT coefficient block is called a DCT 

like. coefficient, and a set of DCT coefficient blocks of one image 

The embedding of digital watermark information accord- is called a DCT coefficient block group, 

ing to the digital watermark method and the resistance As shown in FIG. 2A, therefore, an input image x is DCT 

parameters which are outputted from the resistance deter- 30 transformed by an image transforming device 201 and a 

mination unit 103 is performed by a digital watermark DCT coefficient block group as its output is used as an input 

embedding unit 104. A process in which a digital watermark of a digital watermark embedding device 202. 

having a strong resistance is embedded in accordance with In the DCT coefficient block group, one DCT coefficient 

the similarity denotes a process in which a digital watermark block to be embedded is selected and one DCT coefficient in 

in which the higher the similarity of an output image is, the 35 the selected DCT coefficient block is quantized, thereby 

more it is difficult to be modified (the more it is difficult to embedding an embedding bit of one bit. 

be lost due to an edition or attack) is embedded. Although At this time, a size of quantization step and a position of 

various methods of embedding a digital watermark accord- the selected DCT coefficient are stored as key information, 

ing to an intensity of the resistance are considered, for For example, a value of the DCT coefficient locating at a 

example, the following method is considered. 40 position of coordinates (u, v) is expressed by s{u, v}, the 

First, the following method has been known as a digital quantization step is labelled to h, and "0" or "1" as a digital 

watermark method. That is, when a multivalue still image is watermark bit is embedded by the following rules, 

taken as an example, the digital watermark embedding In the following equation (1), a value of (a) is obtained, 
method can be largely classified into the following two 

methods: a method of embedding a digital watermark into a 45 a-h<s{u, v}^(a+i>/» (l) 

space region: and a method of embedding it into a frequency „ w , . 

region. The following various methods have been known. ™h™ ^ e embedding bit-0, the following operation is 

Among examples of the method of embedding a digital P er orme * 

watermark into the space region, as methods by a , vUb-h+hn (2) 

patchwork, the following methods can be mentioned: a 50 

method of IBM Ltd. (W. Bender, D. Gruhl, and N. ( D is one (even number) of "a" and "a+1") 

Morimoto, "Techniques for Data Hiding", Proceedings of when the embedding bit-1, the following operation is 

the SPIE, San Jose Calif., U.S.A., February, 1995); a method performed. 

of G. B. Rhoads and W. Linn, "Steganography methods 

employing embedded", U.S. Pat. No. 5,636,292; and the 55 c{u, v}=b-h+m (3) 
like. 

Among examples of the method of embedding a digital C 5 is one ( odd number) 0 f « a » anc j « a +l") 

watermark into the frequency region, as a method using the c{u, v} is a coefficient after the embedding. The values of 

discrete cosine transformation, besides a method of NTT the coordinates (u, v) and quantization step h become 

Corp. (Nakamura, Ogawa, and Takashima, "Digital water- 60 the key information here. Finally, the block group is 

mark system in frequency region for protection of copyright IDCT (Inverse DCT) transformed by using an image 

of digital image", SCIS* 97 — 26A, January, 1997) can be inverse transforming device 203, thereby returning it to 

mentioned, and as a method using the discrete fourier the blocks each comprising (8x8) pixels and recon- 

transformation, a method of National Defense Academy structing them. 

(Ohnishi, Oka, and Matsui, "Watermark signature method to 65 As for the extraction of the embedding bit, as shown in 

image by PN series", SC1S* 9726B, January, 1997) can be FIG. 2B, in the DCT coefficient block group subjected to a 

mentioned. similar DCT by the image transforming device 201, the 
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position of the embedded DCT coefficient and the value of includes a digital watermark method of embedding a digital 

h are obtained by using the stored key inform atioo by a watermark into binary information, 

digital watermark extracting device 205. In the following [Second Embodiment] 

equation (4), a value of "b" is obtained. FIG. 3 shows a schematic diagram for explaining the 

5 second embodiment of the invention. Particularly, the simi- 

hh<c{u, v}£{b+i)-h (4) larity extraction unit 102 is replaced with a digital water- 

If "b" is an even number, the embedding bit is determined mark extraction unit 302. The second embodiment is made 

as "0". If it is an odd number, the embedding bit is decided b y presuming a case where digital watermark information 

as "1*'. which is difficult to be identified by the human eyes has 

In this embedding method, the following methods of 30 previously been embedded in the specific image 106 such as 

selecting the resistance are considered. When one DCT bill, securities, or the like. 

coefficient to be embedded is selected from the DCT cocf- Such a presumption is a practical presumption because 

ficient block, if a DCT coefficient showing a low frequency whe n a digital watermark technique is generally used as 

component is selected, the resistance can be enhanced. This means for protection of the copyright or prevention of a 

is because there is a such nature that although a high forgery in future, it is well considered that specific infor- 

frequency component is easily lost by the image 15 rnatioo indicating that bills or securities relate to information 

compression, various filtering processes, or the like, the low whose copy or forgery is prohibited is embedded as digital 

frequency component is difficult to be lost. watermark information into the bills or securities by a 

The resistance can be also enhanced by increasing the predetermined method, 
value of the quantization step h. This is because the larger Since the processes of the other portions are similar to 

the quantization step h is, the more the operation amounts in 20 & os & m tne first embodiment, they are designated by the 

the equations (2) and (3) increase, and it becomes difficult to same reference numerals and their descriptions are omitted 

be changed to another value by various modifying pro- here and only the digital watermark extraction unit 302 will 

cesses. be described. 

Although the case where the number of DCT coefficient The digital watermark extraction unit 302 is an extracting 

blocks to be selected and the number of DCT coefficients to 25 device of a digital watermark embedding method which has 

be embedded have been set to 1 has been described in the been predetermined for the specific image 106. From the 

foregoing embedding method, the resistance can be also input image 101 which the operator intends to output, digital 

enhanced by increasing the numbers of them. This is watermark information is first extracted by a predetermined 

because if one bit was merely embedded into one DCT procedure by the digital watermark extraction unit 302. 
coefficient, a possibility that its value is lost by various 30 Subsequently, the extracted digital watermark informa- 

modifying processes is large^ however, if the same bit is ^ ^ compared ^ ^ cihc ^formation indicating that it 

embedded in a plurality of DCT coefficients, a possibility ^ ^ whose or f fc prohib ited, md 

that most of them are lost is small. ........ , *"* r , , , . . 

■ , , i u j u its similarity is outputted. This similarity can be calculated 

Ihe resistance can be also enhanced by error correction , A *_ j r * i_ ^ ^ j- i * ■ 

encoding the bits themselves to be embedded. This is ^ a method of companng bits of the digital watermark 

because even if some of the embedding bits were lost, they 35 information with those of the specific information or the 
are reconstructed by an error correction code. It will be n * calculated similarity is inputted to the digital 

obviously understood here that the higher a correcting watermark embedding unit 104 and processes (as the simi- 

ability of the error correction code which is used is, the larit y & higher, a digital watermark of a stronger resistance 

stronger the resistance is. is embedded) similar to those in the foregoing first embodi- 

However, according to those methods, although the resis- 40 ment are executed, 
tance is enhanced, there is a case where a low frequency In the case where an image obtained by performing a 
component of an image is changed or a quality of an image modifying process to the specific image 106 for the purpose 
slightly deteriorates because many bits are embedded. If the of forging the specific image 106 is used as an input image, 
operation opposite to those mentioned above is performed, the embedded digital watermark information is also modi- 
a digital watermark method of a high picture quality can be 45 fied. The similarity which is extracted by the digital water- 
realized although the resistance is weakened, mar k extraction unit 302 differs depending on the performed 

The method of enhancing the resistance as mentioned modifying process. However, if a modifying process by 

above is not limited to the method using the DCT but has a whicn ^ watermark information of the input image 

similar tendency as for the method using the wavelet trans- ^ { x lost fe performed, since a picture quality also 

formation or Fourier transformation or the method of 50 genera Uy largely deteriorates, whether the forgery has been 

embeddmg a digita watermark mtc . the space regioru performed or not can be discriminated^ the human eyes. 

By selecting the foregoing digital watermark embeddmg c ^ which the 
method and the parameters such as frequency component, , , . ^ 37 . „ * ? v . 4 A . - , 
quantization step, the number of embedding digital deterioration of the picture quality is deterred is performed 
watermarks, error correction code, and the like in accor- * e ™danty of the digital watermark information extracted 
dance with the similarity from the resistance determination 55 b y the watermark extraction unit 302 rises and the 
unit 103 as mentioned above, the digital the similarity is digital watermark information of a strong resistance accord- 
realized by the digital watermark embedding unit 104 and an in g thereto is embedded by the digital watermark embedding 
output image 105 is outputted. unit 104. Therefore, the forgery can be deterred also by this 

Identification information such as device number, product embodiment, 

number, and the like of an output device and various 60 [Third Embodiment] 

information including an output date/time and the like are FIG. 4 shows a schematic diagram for explaining the third 

considered as digital watermark information which is embodiment of the invention. Although the first and second 

embedded. embodiments have been described with respect to the 

Although the embodiment has been described with example of using the digital watermark which is difficult to 

respect to the digital watermark of a multivalue image as an 65 be identified by the human eyes, the digital watermark can 

example, the digital watermark which is used in the embodi- be also combined with a transforming process such as color 

ment is not limited to the multivalue digital watermark but transformation, tilted type transformation, enlargement, 
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reduction, or the like by which the image can be identified 
by the human eyes as shown in the foregoing EP 0529746 
Bl. 

That is, if the similarity which is outputted from the 
similarity extraction unit 102 is equal to or larger than a 
predetermined value, the transforming process by which the 
image can be identified by the human eyes is performed to 
the input image. If the similarity is less than the predeter- 
mined value, a digital watermark embedding process having 
a predetermined resistance in which the image is difficult to 
be identified by the human eyes is performed in an image 
transformation unit 404. 

The transforming process and the resistance are deter- 
mined by a process determination unit 403. Further, in the 
case where the similarity is high and the input image almost 
coincides with the specific image and the input image is 
presumed as a specific image 106 whose copy or forgery is 
prohibited, it is also possible to combine with an image 
transformation such as stop of the output, execution of a 
process for painting in black by which the resultant image 
cannot be used, or the like. 

Such a correspondence of the processes can be realized by 
using a table in which it has previously been stored, or the 
like. In the embodiment, the similarity extraction unit 102 
can be also replaced with the digital watermark extraction 
unit 302. 

[Fourth Embodiment] 

In the embodiments 1 and 2, the color spectrum distribu- 
tion of the image, image pattern, size, or the like is extracted 
(embodiment 1) or the digital watermark is extracted 
(embodiment 2) and the similarity between the input image 
and the specific image is calculated. However, it is also 
possible to perform the extraction of the similarity in the 
embodiment 1 and the extraction of the digital watermark in 
the embodiment 2 in parallel and obtain the total similarity 
by using results which are extracted, respectively (FIG. 6). 

Thus, even if the input image is processed to obstruct 
either the similarity extraction 102 in the embodiment 1 or 
the digital watermark extraction 302 in the embodiment 2, 
the feature of the specific image which is not obstructed can 
be extracted by either the similarity extraction 102 or digital 
watermark extraction 302. 

Even in case of the bills, for example, a case where a 
digital watermark is embedded in bills of a certain country 
and no digital watermark is embedded in bills of another 
country is also considered. However, it is possible to cope 
with bills and securities of various countries by having both 
of the similarity extraction 102 and digital watermark 
extraction 302. 
[Other Embodiments] 

The invention is not limited only to the apparatuses and 
methods for realizing the above embodiments and the 
method by a combination of the methods described in the 
embodiments but the invention also incorporates a case 
where program codes of software to realize the foregoing 
embodiments are supplied to a computer (a CPU or an MPU) 
in the system or apparatus and the computer of the system 
or apparatus makes each of the various devices in accor- 
dance with the program codes, thereby realizing the embodi- 
ments. 

In this case, the program codes themselves of the software 
realize the functions of the embodiments and the program 
codes themselves and means for supplying the program 
codes to the computer, specifically speaking, a storage 
medium in which the program codes have been stored is also 
incorporated in the invention. 

As a storage medium for storing such program codes, for 
example, a floppy disk, a hard disk, an optical disk, a 
magnetooptic disk, a CD-ROM, a magnetic tape, a non- 
volatile memory card, an ROM, or the like can be used. 
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The program codes are also incorporated in the invention 
not only in the case where the computer controls various 
devices in accordance only with the supplied program codes, 
so that the functions of the embodiments are realized but 
also in the case where the program codes cooperate with the 
OS (Operating System) which is operating on the computer, 
another application software, or the like and the embodi- 
ments are realized. 

Further, the invention also incorporates a case where the 
supplied program codes are stored into a memory equipped 
for a function expanding board of a computer or a function 
expanding unit connected to the computer and, thereafter, a 
CPU or the like equipped for the function expanding board 
or function expanding unit executes a part or all of the actual 
processes on the basis of instructions of the program codes, 
and the embodiment is realized by those processes. 

As described above, since the digital watermark having 
the resistance according to the similarity with the specific 
image such as bill, securities, or the like whose copy or 
forgery is prohibited is embedded, the deterrent of the 
forgery of the specific image according to the similarity can 
be realized while outputting the image which the operator 
intends to output. 

Since the process can be selected in a manner such that the 
image having a relatively high similarity is subjected to the 
process by which the image can be identified by the human 
eyes and the image having a relatively low similarity is 
subjected to the process by which the image is difficult to be 
identified by the human eyes, both the prevention of the 
forgery of the specific image such as bill, securities, or the 
like whose copy or forgery is prohibited and the protection 
of the picture quality can be realized. 

What is claimed is: 

1. An image processing apparatus comprising: 
input means for inputting image information; 
discriminating means for discriminating a similarity 

between said image information and a specific image; 
and 

embedding means for embedding a digital watermark 
having higher resistance in proportion to an increase of 
said similarity, into said image information. 

2. An apparatus according to claim 1, wherein said 
resistance changes due to said digital watermark embedding 
method or said resistance parameter. 

3. An apparatus according to claim 1, wherein said digital 
watermark includes a watermark which is embedded into a 
space region and a watermark which is embedded into a 
frequency region. 

4. An apparatus according to claim 1, wherein said 
specific image includes a bill or securities. 

5. An image processing method comprising: 
an input step of inputting image information; 

a discriminating step of discriminating a similarity 
- between said image information^ and a specific image; 
and 

an embedding step of embedding a digital watermark 
having higher resistance in proportion to an increase of 
said similarity, into said image information. 

6. A computer-readable storage medium which stored an 
image processing program, wherein said program com- 
prises: 

an input step of inputting image information; 

a discriminating step of discriminating a similarity 

between said image information and a specific image; 

and 

an embedding step of embedding a digital watermark 
having higher resistance in proportion to an increase of 
said similarity, into said image information. 
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